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ONGUSSIFIEO 


management  response  of  system  and  subsystem  contractors  is 
described  in  areas  of  operating  policies  and  procedures, 
project  organization,  cost  management  and  control,  and 
development  program  planning.  The  contractor  experiences 
during  their  engineering  development  programs  are  sub- 
sequently evaluated  in  terms  of  operating  problems  or  policy 
barriers.  In  total,  the  experiences  of  43  contractors 
responding  in  25  separate  programs  are  examined  and  analyzed. 
Based  upon  their  past  experiences  and  management  behavior, 
the  appropriate  response  to  successfully  embrace  future 
policy  initiatives  is  postulated.  /j\ 

This  paper  is  to  be  presented  at  the  1978  Reliability  and 
Maintainability  Symposium  held  in  Los  Angeles,  January  17-19, 
1978.  It  also  is  to  be  published  as  part  of  the  proceedings 
of  the  symposium.  This  paper  has  been  prepared  with  the 
permission  of  the  symposium  program  committee  in  order  to 
permit  greater  distribution  of  the  information  contained 
herein. 


tccumry  CLAUiricATiON  or  this  »*acrvf>wi  om«  ti>nrw^> 


\ 


3 


3 


2 


IDA  PAPER  P-1291 


CONTRACTOR  INITIATIVES  FOR  RELIABILITY, 
MAINTAINABILITY.  AND  COST  IMPROVEMENT 


C.  David  Weimer 


September  1977 


ID^ 

INSTITUTE  FOR  DEFENSE  ANALYSES 
COST  ANALYSIS  GROUP 
400  Army-Navy  Drive,  Arlington, Virginia  22202 

IDA  Independent  Research  Program 


A.  Corporate  Policies  and  Procedures  12 

. B.  Project  Organizations  l4 

C.  Cost  Management  Changes 17 

' D.  Development  Program  Planning l8 

1.  Design l8 

2.  Analysis 20 

3.  Materials  Management 20 

4.  Prototype  Manufacture  21 

5.  Equipment  Test 21 

6.  Quality  Assurance  21 

7.  Program  Management 22 

8.  Financial  Management 22 

9.  Product  Support  Planning 23 

10.  Production  Engineering 23 

11.  Value  Engineering  23 

12.  Data  and  Reports 24 

13.  Contract  Management  24 

‘ E.  Summary  of  Development  Program  Response  ....  24 

IV.  CONTRACTOR  RESPONSE  AND  CONTRACTOR  SUCCESS 27 

V.  BARRIERS  TO  CONTRACTOR  RESPONSE  29 

VI.  FUTURE  DEVELOPMENT  PROGRAM  PLANNING  33 


111 


M 


VII.  CONCLUSIONS 35 

BIBLIOGRAPHY  37 

FIGURES 

1 Acquisition  Policy  Application  and  Implementation.  . . 2 

2 Typical  Functional  Work  Breakdown  Structure 19 

3 Summary  of  Development  Program  Impact 26 

TABLES 

1 Policy  Directives  and  Implementing  Memoranda  6 

2 DTC  Contract  Requirements  and  Contractor  Policies.  . . 13 

3 DTC  Policy  and  Procedure  Characteristics  15 

4 Policy  Barriers  and  Problem  Areas 30 


r ^ 


NOTE 

This  paper  was  written  as  part  of  the  IDA  Cost  Analysis 
Group's  continuing  research  program  on  "Cost  Concepts  and 
Methodology"  and  was  funded  as  part  of  IDA's  independent 
research  effort.  The  paper  Is  to  be  presented  at  the  1978 
Reliability  and  Maintainability  Symposium  held  in  Los  Angeles, 
January  17-19,  1978.  It  also  is  to  be  published  as  part  of 
the  proceedings  of  the  symposium. 


? 

\ 


ABSTRACT 

This  paper  presents  a synthesis  of  major  findings  and  con- 
clusions derived  from  four  years  of  research  in  electronics 
subsystem  acquisition.  Department  of  Defense  policy  statements 
for  achieving  improved  reliability,  maintainability,  and  cost 
are  reviewed.  The  application  and  implementation  of  these 
policies  are  examined  and  the  management  response  of  system  and 
subsystem  contractors  is  described  in  areas  of  operating  poli- 
cies and  procedures,  project  organization,  cost  management  and 
control,  and  development  program  planning.  The  contractor 
experiences  during  their  engineering  development  programs  are 
ubsequently  evaluated  in  terms  of  operating  problems  or 
policy  barriers.  In  total,  the  experiences  of  ^3  contractors 
responding  in  25  separate  programs  are  examined  and  analyzed. 
Based  upon  their  past  experiences  and  management  behavior,  the 
appropriate  response  to  successfully  embrace  future  policy 
initiatives  is  postulated. 


I 

INTRODUCTION 

During  the  past  six  years,  the  Office  of  the  Secretary  of 
Defense  (OSD)  and  the  Services  have  been  attempting  to  change 
the  output  of  the  weapons  system  and  subsystem  acquisition 
process.  In  particular,  these  offices  have  initiated  acquisi- 
tion policies  designed  to  reduce  cost  growth  and  to  improve 
equipment  reliability  and  maintainability.  The  focus  of  the 
policies  has  been  the  critical  design  and  development  phase, 
where  basic  decisions  influencing  future  product  cost, 
reliability,  and  maintainability  are  made. 

Electronics  system  and  subsystem  contractors  can  pursue 
the  objectives  of  the  policies  in  two  primary  ways;  (1)  through 
the  application  of  new  technology  which  promises  greater  sim- 
plicity, higher  reliability,  and  lower  cost  per  function;  and 
(2)  through  Improvements  in  the  planning  and  management  of 
program  activities  for  reduced  cost  and  higher  reliability  dur- 
ing development.  The  planning  and  management  function  is 
believed  to  be  as  critical  a determinant  of  program  outcome  as 
new  technology  utilization — there  is  considerable  evidence  that 
the  benefits  gained  through  the  use  of  advanced  electronics 
technology  have  been  partially  offset  by  Increased  performance 
requirements.  The  results  often  have  been  greater  equipment 
complexity,  leading  to  reduced  equipment  reliability  and  in- 
creased life-cycle  cost. 

The  topic  of  contractor  response  to  defense  acquisition 
policies  can  be  displayed  in  diagramatic  form  as  shown  in  Figure 
1.  The  figure  Illustrates  the  flow  of  policy  directives  and 
subsequent  Implementing  instruction  from  the  government  to  the 
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Figure  1.  ACQUISITION  POLICY  APPLICATION  AND  IMPLEMENTATION 


contractor  organization  and  eventually  to  functional  organiza- 
tions within  the  contractor.  Even  in  this  simplistic  view  of 
the  process,  the  contractors  do  not  operate  in  a vacuum.  Out- 
side influences  exist,  ranging  from  other  forms  of  governmental 
intervention  to  the  political,  economic,  and  competitive  busi- 
ness environment.  These  external  forces  frequently  enter  into 
and  alter  the  form  of  contractor  response.  This  paper  will 
examine  some  of  the  key  contractor  functions  Illustrated  to 
identify  changes  that  result  from  new  policy  application. 


POLICY  INITIATIVES 


Major  DoD  policy  statements  take  the  form  of  DoD  Directives  t; 

or  Memoranda  to  Service  Secretaries  from  OSD  principals.  Table 
1 lists  several  recent  policy  directives  and  Implementing  memo- 

1 

randa  that  are  directly  concerned  with  cost,  reliability,  or 
maintainability . 

The  emphasis  of  these  policy  directives  has  been  on  cost 
rather  than  reliability  or  maintainability.  The  first  DoD 
Directive,  5000,1,  established  cost  as  a primary  design  param- 
eter. This  launched  the  DoD  Design-to-Cost  (DTC)  acquisition 
policy.  Subsequent  directives  and  memoranda  expanded  and  ampli- 
fied the  original  concept. 

Reliability  and  Maintainability  (R&M)  objectives  usually 
were  contained  in  the  directives  as  surrogates  for  support  cost 
goals.  Where  present,  they  were  to  be  given  emphasis  equal  to 
acquisition  costs.  Specific  policy  guidance  tailored  for  R&M 
has  only  recently  surfaced  in  the  form  of  draft  directives. 

The  major  R&M  policy  initiatives  to  date  have  been  the 
establishment  of  Reliability  Improvement  Warranties  (RIWs), 
reliability  guarantees,  and  Support  Cost  Guarantees  (SCGs)  as 
contract  options  to  equipment  production  contracts.  These 
requirements  emphasize  field  R&M  through  equipment  performance 
guarantees.  Application  of  these  techniques  to  new  system 
procurements  increased  following  the  1973  RIW  memorandum. 

Two  new  draft  policy  directives,  presently  being  reviewed 
I prior  to  issue,  deal  directly  with  R&M.  They  call  for  methods 
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Table  1.  POLICY  DIRECTIVES  AND  IMPLEMENTING  MEMORANDA 


to  predict  R&M  of  proposed  systems  and  consideration  of  R&M  as 
a major  concern  during  all  phases  of  the  acquisition  process. 

Note  that — particularly  for  DTC  policies — several  years 
elapsed  between  initial  policy  establishment  and  more  specific 
guidelines  for  Service  implementation.  Refinements  incorporat- 
ing lessons  learned  on  the  initial  experiments  or  trials  sub- 
sequently resulted  in  updated  and  revised  policy  directives  as 
the  concepts  matured.  To  understand  contractor  response  to 
these  policies,  we  will  briefly  examine  the  manner  in  which 
these  policies  have  been  applied. 

A.  POLICY  APPLICATION 

While  the  DoD  policy  directives  may  be  explicit  in  their 
objectives  and  the  approach  to  be  followed,  changes  in  the 
acquisition  process  and  in  the  management  of  product  develop- 
ment do  not  occur  unless  the  policies  are  translated  into 
implementing  Instructions  and  contract  clauses  reflecting  the 
application  of  the  policies  to  the  specific  program.  No  matter 
how  much  publicity  was  given  to  the  new  policies,  the  response 
of  many  contractors  was  found  to  be  dependent  upon  their  speci- 
fic interpretation  of  current  or  future  contractual  commitments. 

Since  the  initial  policy  statements  were  published,  studies 
at  IDA  and  elsewhere  have  been  conducted  to  measure  the  progress 
of  these  initiatives  as  they  were  applied  to  the  first  candidate 
development  programs.  The  findings,  described  below,  are  of 
particular  Interest  because  they  form  the  basis  for  explanatory 
rationale  for  subsequent  contractor  behavior. 

1 . Design-to-Cost  Policies 

The  contractual  requirements  for  eight  original  programs 
designated  by  the  Services  as  price-limited  prototypes  were 
analyzed.  Key  findings  were: 


(1)  Seven  of  the  eight  price-limited  prototypes  had 
entered  development  before  being  designated  as  a 
design-to-cost  candidate.  At  least  four  of  the  eight 
experiments  were  well  into  their  engineering  develop- 
ment programs  at  a stage  where  most  of  the  critical 
design  decisions  already  had  been  made  and  approved. 

(2)  Because  of  the  timing,  the  contractual  DTC  applica- 
V,  tlon  for  most  of  the  programs  resulted  in  either 

'^mended  provisions  to  the  initial  contract  or  in- 
complete contract  requirements. 

(3)  A key  ingredient  of  the  DTC  policy  is  development 
program  flexibility  (cost  and  schedule)  in  order  to 
perform  design  Iterations  for  goal  achievement.  Only 
thirty  percent  of  the  programs  were  able  to  obtain 
additional  time  or  funds  for  design  iterations. 

(4)  The  most  Inconsistent  contract  requirement  was  in  the 
area  of  equipment  cost  estimating  and  reporting.  The 
Government  in  many  cases  had  little  visibility  into 
the  status  or  progress  of  the  production  cost  manage- 
ment efforts. 


2 . Reliability  Guarantee  Policies 

In  a manner  similar  to  the  deslgn-to-cost  policies,  the 
Initial  programs  containing  future  requirements  for  reliability 
guarantees  or  warranties  were  analyzed.  The  findings  were 
parallel.  Most  of  the  development  contracts  did  not  specify 
requirements  for  the  future  guarantees;  terms  and  conditions 
were  negotiated  and  finalized  during  the  terminal  stages  of 
the  development  program,  at  a stage  where  little  development 
program  impact  could  be  realized.  Unlike  the  DTC  requirements, 
however,  the  finalized  contract  requirements  were  generally 
complete  and  followed  uniform  guidelines  established  by  OSD 
and  the  Services.^ 


^The  author  believes  this  can  be  attributed  in  large  neasure  to  the  advisory 
role  the  ARINC  Research  Corporation  played  in  assisting  the  Services  design 
warranty  provisions.  Thus,  the  Arrrcr  and  Air  Force  contract  clauses  are 
constructed  uniformly  and  read  very  much  the  same. 
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An  additional  contractual  ingredient  of  the  reliability 
guarantees  was  the  potential  financial  risk  associated  with 
warranty  provisions  and  consignment  spare  requirements  if 
future  field  reliability  did  not  achieve  predicted  values. 
Contractors  found  that  they  were  required  to  price  warranties 
based  upon  specified  reliability  and  maintainability  levels 
with  only  limited  development  program  data  to  predict  their 
ultimate  field  reliability  and  warranty  cost. 

B.  SUMMARY 

In  the  two  policies  examined,  it  was  observed  that  trans- 
lation of  broad  policy  directives  into  specific  contractual 
requirements  took  time  and  was  not  easily  accomplished  during 
an  on-going  and  previously  planned  development  program.  This 
was  particularly  critical  when  the  policy  was  Intended  to 
Influence  the  design  of  the  equipment  and  the  conduct  of  the 
development  program. 


* 


III 

CONTRACTOR  INITIATIVES 

A primary  objective  of  this  paper,  and  a key  output  of  our 
previous  research,  is  the  Identification  of  contractor  response 
or  behavior  as  a result  of  the  policy  directives.  It  will  be 
several  years  before  the  success  or  failure  of  these  policies 
can  be  determined  from  equipment  production  cost  or  field  oper- 
ating performance;  changes  in  the  management  or  conduct  of  the 
development  program,  giving  emphasis  to  policy  objectives,  may 
be  reliable  Indicators  of  future  policy  success.  Of  equal 
Importance,  problem  areas  or  barriers  that  prevent  policy  ob- 
jectives from  being  pursued  may  be  discovered  and  resolved  in 
time  to  obtain  positive  benefits.  Finally,  the  aggregate  ex- 
periences of  the  contractors  in  responding  to  these  recent 
policy  initiatives  should  help  other  contractors  or  subcontrac- 
tors in  formulating  development  program  plans  and  negotiating 
contracts  containing  similar  policy  requirements. 

Our  Investigations  into  contractor  policy  response  identi- 
fied several  areas  where  the  Impact  of  the  DoD  policy  directives 
could  be  observed.  Contractors  who  successfully  adopted  the 
new  acquisition  policies  did  so  through  the  formalization  of 
their  own  new  or  revised  operating  policies  and  procedures. 

This  effectively  endorsed  the  new  acquisition  mode  and  pro- 
vided credibility  for  the  Internal  changes  that  subsequently 
were  Implemented.  Contractual  requirements,  reflecting  the 
new  acquisition  policies,  also  led  to  changes  in  contractor 
organizational  structures  and  their  Internal  cost  management 
systems.  As  the  discipline  evolved  for  achieving  greater  cost 
and  reliability  visibility  during  development,  changes  were 


observed  in  the  planning  of  the  engineering  development  program. 
These  changes  required  more  effort  to  be  spent  in  several  key 
functional  areas.  The  details  of  these  responses  will  be  ex- 
amined in  the  following  sections. 


A.  CORPORATE  POLICIES  AND  PROCEDURES 

If  D<  '^nent  changes  in  the  conduct  of  design  and  develop- 
ment prc^,'  ' o be  accomplished,  we  expected  to  find 

either  nev  ■ ed  corporate  operating  policies  and  pro- 


elther  nev  ■ ed  corporate  operating  policies  and  pro- 

cedures c;h'>t  c'-  oed  the  new  Government  policies.  DTC 
represented  a significant  change  in  development  program 
priorities;  therefore,  some  means  of  legitimizing  or  authoriz- 
ing program  planning  for  DTC  was  anticipated.  Our  investiga- 
tion found  that  sixteen  of  the  twenty-two  contractors  surveyed 
had  either  developed  or  were  preparing  new  DTC  operating  poli- 
cies and  procedures.  Contractors  who  were  not  responsive  stated 
that  corporate  or  divisional  directives  were  inappropriate  be- 
cause of  the  variety  of  programs  being  accomplished  or  because 
other  existing  procedures  provided  the  guidance  necessary  to 
respond. 

Investigations  into  the  DTC  requirements  that  affected 
policy  establishment  Identified  requirements.  Illustrated  in 
Table  2,  which  apparently  led  to  the  formalization  of  the  DTC 
process.  All  but  one  contractor  who  established  DTC  policies 
and  procedures  had  requirements  for  frequent  and  periodic 
production-cost  estimating,  tracking,  and  reporting.  Only 
half  of  the  contractors  without  policies  were  subjected  to  any 
cost-reporting,  and  these  requirements  were  minimal — two  re- 
ports per  program. 

Another  significant  difference  found  in  the  contractor 
requirements  was  provision  for  award  fees.  Most  of  the  con- 
tractors with  DTC  policies  and  procedures  were  also  working 
toward  award  fees  based  upon  their  willingness  to  negotiate 
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Table  2.  DTC  CONTRACT  REQUIREMENTS  AND  CONTRACTOR  POLICIES 


/ 

COMTRACTORS  WITH  DTC  POLICIES  AMD  PROCEDURES 

B 

YES 

YES 

YES* 

NO 

H 

YES 

YES 

res" 

YES 

M 

YES 

YES 

YES* 

YES 

Q 

NO 

NO 

YES* 

NO 

R 

YES 

YES 

yes'* 

YES 

S 

YES 

YES 

NO 

YES 

T 

YES 

NO 

c 

YES 

V 

YES 

YES 

YES* 

YES 

P 

NO 

YES 

yes'* 

NO 

COMTRACTORS  WITHOUT  DTC  POi 

1 

1 

! 

0 

YES 

NO 

YES** 

YES 

E 

NO 

YES 

NO 

NO 

G 

YES 

YES 

NO 

NO 

J 

YES 

YES 

NO 

NO 

K 

YES 

YES 

YES** 

NO 

0 

YES 

YES 

yes'* 

NO 

* Monthly  cost  reports. 


^ Proiram  milestone  cost  reports. 

‘ Data  not  available, 
d 

Desifn  reviews  only  (two  per  EO  program). 
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a production  contract  at  the  product  design  cost  (price).  Thus 
a causal  relationship  was  found  between  contract  requirements 
for  cost  tracking  and  reporting,  contract  incentives  for 
achieving  production  cost  goals,  and  the  policy  and  procedural 
response  of  the  contractor. 

The  DTC  policies  and  procedures  furnished  by  eight  con- 
tractors were  examined  for  characteristics  that  would  Indicate 
scope,  level  of  detail,  origin,  source  of  authority,  and  topics 
covered.  The  results  of  this  analysis  are  presented  in  Table  3 

The  final  area  for  analysis  was  functional  coverage. 
Functions  relating  to  organizational  relationships,  cost  track- 
ing, product  engineering,  and  production  were  covered  by  the 
majority  of  contractors.  However,  uniform  coverage  of  cost 
estimating  or  validation  testing — two  critical  ingredients  in 
the  DTC  concept — were  lacking.  Emphasis  on  subcontractor 
management  or  material-purchasing  functions  were  covered  by 
six  of  eight  contractors. 

Policies  or  procedures  governing  changes  to  design  and 
development  programs  for  Improved  or  guaranteed  reliability 
and  maintainability  were  not  found  in  our  contractor  surveys. 
Based  on  our  experience  with  DTC  policies,  this  finding  was  not 
surprising.  In  the  reliability  and  maintainability  area, 
specific  new  reports  or  program  actlvitj.es  were  not  required  by 
the  Government  during  engineering  development.  Therefore, 
changes  for  increased  R&M  responsibility  did  not  have  to  be 
formalized;  each  program  manager  could  take  whatever  steps  he 
felt  necessary  to  acquire  R&M  data,  demonstrate  his  future 
product  performance,  and  quantify  his  potential  warranty  risk. 

B.  PROJECT  ORGANIZATIONS 

The  second  area  of  policy  Impact  Investigated  was  project 
organization.  Several  significant  organizational  changes  v;ere 


Table  3.  DTC  POLICY  AND  PROCEDURE  CHARACTERISTICS 


Contractor  T issued  both  division  and  program  policies  and  procedures. 


found  as  a result  of  the  new  policies.  The  most  common  organi- 
zational response  to  DTC  policies  was  the  addition  of  DTC  staff 
support  to  the  program  manager.  This  response  was  especially 
common  in  pure  project  organizational  arrangements.  Other  con- 
tractors created  DTC  line  organizations  or  specialized  DTC 
engineering  staffs.  All  contractors  who  added  to  their  engi- 
neering staffs  were  organized  in  a matrix  form,  each  member  of 
the  project  organization  reporting  to  both  their  functional 
supervisor  and  the  program  manager. 

The  most  influential  factors  believed  to  be  responsible 
for  the  organizational  changes  were  again  Government  require- 
ments for  production  cost  estimating,  tracking,  and  reporting. 
Ten  contractors  stated  this  requirement  to  be  a principal 
reason  for  their  organizational  change.  Contractors  also 
believed  that  the  emphasis  and  importance  attached  to  DTC  by 
the  Government  program  offices  were  primary  motivating  factors 
in  organizational  response.  Other  reasons  for  change  were 
requirements  for  life-cycle  cost  analyses  and  continuing  pro- 
ducibillty  analyses  and  planning. 

Several  contractors  who  reported  no  formal  organizational 
change  responded  to  DTC  requirements  through  establishment  (on 
a periodic  or  need  basis)  of  ad  hoc  DTC  committees,  or  they 
used  existing  organizations  (e.g.,  systems  engineering)  to 
provide  the  necessary  response. 

In  addition  to  organization  structure,  the  content  of 
project  organizations  was  found  to  be  influenced  by  the  new 
policies.  Significant  additions  to  the  project  staff  were 
observed  in  the  functional  specialty  areas  of  production  engi- 
neering, maintainability  engineering,  and  reliability  engineer- 
ing. These  functional  disciplines  were  needed  to  help  predict 
product  cost,  reliability,  and  maintainability  throughout  the 
development  program. 
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C.  COST  MANAGEMENT  CHANGES  i 

£ 

As  the  policy  concepts  were  translated  into  specific  con-  I 

i 

tract  requirements,  it  became  necessary  for  contractors  to 
devote  more  attention  to  future  production  cost  during  the  ' 

development  program.  DTC  requirements  for  production  cost  j 

estimates  at  the  beginning  of  engineering  development  and  the 
requirements  for  periodic  updates  of  the  initial  estimates 
meant  that  contractors  would  develop  capabilities  to  estimate 
production  cost  based  upon  early  conceptual  descriptions, 
track  these  estimates  at  detailed  levels,  and  report  the  esti- 
mates to  Internal  management  and  the  Government.  In  order  for 
the  deslgn-to-cost  goals  to  be  achieved,  the  cost  estimates 
had  to  be  visible  to  design  engineers  on  a timely  basis.  This 
required  a time-sensitive  management  information  system  that 
would  provide  cost  estimators  with  nev;  design  concepts  and 
design  engineers  with  the  cost  estimates  of  their  designs. 

Cost  management  changes  were  also  required  as  reliability 
warranties  and  guarantees  were  introduced  as  options  to  be 
priced  prior  to  production  contract  award.  Early  in  the  engi- 
neering development  program,  the  cost  of  contractor  repair  and 
maintenance  had  to  be  considered  so  that  these  factors  could 
also  Influence  the  design.  Cost  estimates  were  needed  to 
influence  repair  or  replace  decisions  during  the  warranty 
period.  And  in  order  to  estimate  the  cost  of  the  warranty, 
estimates  were  needed  for  the  cost  of  repair  labor  and  mater- 
jals,  the  cost  of  diagnostic  and  acceptance  testing,  and  in  the 
case  of  guaranteed  MTBF  requirements,  the  cost  of  consignment 
spares  to  maintain  field  availability. 

The  management  of  future  costs  during  the  design  phase  re- 
quired that  the  contractor  become  proficient  in  at  least  three 
functional  areas;  cost  estimating,  cost  estimate  tracking  and 
reporting,  and  cost  estimate  control.  For  many  contractor 
organizations,  these  requirements  were  new.  Contractors 
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were  Just  beginning  to  implement  the  latest  Government  require- 
ments for  the  management  and  control  of  on-going  development 
programs  in  accordance  with  DoD  cost/schedule  control-systems 
criteria  (C/SCSC).  Requirements  for  future  equipment  and  opera- 
tions cost  estimating  represented  additional  efforts.  New 
management  information  systems  had  to  be  developed  and  exist- 
ing capabilities  in  cost  estimating  augmented. 

D.  DEVELOPMENT  PROGRAM  PLANNING 

The  final,  and  perhaps  the  most  important  area  of  contrac- 
tor response,  is  development  program  planning  and  execution. 

In  this  case,  we  are  concerned  with  changes  made  to  development 
programs  as  a result  of  the  Increased  emphasis  on  cost,  relia- 
bility, and  maintainability. 

As  a frame  of  reference,  a functional  work  breakdown 
structure  for  a typical  engineering  development  program  has 
been  constructed.  Figure  2 Illustrates  the  thirteen  functional 
elements  that  were  analyzed  during  the  research. 

It  should  be  noted  that  the  financial  management  and  con- 
tract management  functions  usually  are  not  directly  chargeable 
to  specific  programs;  they  are  indirect  charges.  Nevertheless, 
since  previous  research  showed  these  functions  were  impacted, 
exhibiting  significant  responsive  changes,  they  have  been  in- 
cluded as  a part  of  the  development  program  functional  structure. 

1 . Des i gn 

The  equipment  design  efforts  were  Increased  for  many  of  the 
contractors  responding  to  the  new  policies.  DTC  policies  often 
resulted  in  several  design  iterations  to  maintain  or  achieve 
the  production  cost  goals.  More  design  effort  also  was  re- 
quired under  policies  of  potential  reliability  warranties  or 
guarantees  because  contractors  were  required  to  design  their 
equipment  for  either  field  organic  maintenance  or  contractor 
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Figure  2.  TYPICAL  FUNCTIONAL  WORK  BREAKDOWN  STRUCTURE 


maintenance.  The  possibility  of  a warranty  also  meant  designs 
which  incorporated  additional  features  such  as  Increased  built- 
in-test,  protective  sensors  or  circuits,  tamper-proof  seals, 
and  elapsed-tlme  indicators.  In  perspective,  the  design  func- 
tion received  large  Impacts  from  both  DTC  and  warranty  poli- 
cies. DTC  policies  created  the  largest  impact  whenever  time 
and  funds  were  available  to  perform  the  necessary  design 
Iterations . 

2.  Analysis 

Analytical  efforts  supporting  designs  also  increased  as  a 
result  of  the  new  policies.  New  tasks  were  undertaken  to  ex- 
plore alternate  materials  and  analyze  additional  configurations 
for  lowering  cost.  Additional  effort  was  found  in  reliability 
and  maintainability  analyses  to  prepare  for  possible  warranty 
or  guaranteed  life-cycle  cost  obligations.  Thus,  analytic 
efforts  increased  together  with  the  design  efforts;  the  magni- 
tude of  the  increase  was  found  to  be  proportional  to  the  timing 
of  the  policy  application  during  the  design  phase. 

3.  Materials  Management 

This  area  received  a large  impact  as  a result  of  the  new 
policies.  DTC  policies  required  constant  updates  of  projected 
production  costs  that  significantly  Increased  communications 
between  prime  and  supporting  subcontractors  and  vendors.  War- 
ranty requirements  also  caused  contractors  to  take  more  care 
with  material  inspections,  certifications  of  quality  control, 
and  in  some  cases,  plant  screening  and  acceptance  testing. 
Contractors  also  attempted,  with  very  limited  success,  to  pass 
their  new  contractual  requirements  on  to  lower-level  subcon- 
tractors. In  general,  there  was  a marked  increase  in  supplier 
communications  and  in  materials  screening  and  testing  prior  to 
development  use. 
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Prototype  Manufacture 


I There  had  been  considerable  discussion  within  the  Industry 

‘ concerning  the  need  for  larger  numbers  of  development  proto- 

r 

\ types  to  support  increased  design  verification  and  test  requlre- 

I ments;  however,  little  increase  in  prototyping  effort  was  ob- 

I 

I served  in  practice.  Two  possible  explanations  are  that  funding 

[ for  additional  prototypes  was  not  available,  or  that  most  of 

the  development  programs  were  structured  without  recognizing 
the  need  generated  by  the  new  policies.  Most  contractors 
believed  they  could  benefit  from  a larger  prototype  or  pilot 
production  program;  however,  they  were  unable  to  obtain  the 
additional  time  and  money  required.^ 


5 . Equipment  Test 

This  element  received  a significant  increase  in  effort  by 
those  contractors  who  were  preparing  for  potential  warranties 
or  reliability  guarantees.  In  a number  of  cases,  prototypes 
were  subjected  to  additional  tests  not  specifically  required  by 
contract  test  specifications.  However,  the  DTC  policies  were 
not  usually  responsible  for  the  increased  test  effort;  most  of 
the  design  Iterations  were  accomplished  prior  to  committing 
hardware  to  the  major  test  programs. 


6.  Quality  Assurance 

Contractors  reported  small  to  moderate  increases  in  qua- 
lity assurance  efforts  primarily  because  potential  warranty 
requirements  made  it  Imperative  that  materials  and  purchased 
parts  be  screened  more  carefully.  Added  effort  was  also 
expended  to  ensure  complete  documentation  of  system  and  com- 
ponent failures  during  development  testing.  DTC  policies  did 


^Thls  was  especially  true  for  those  programs  containing  development  phase 
competition. 
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not  appear  to  impact  the  quality  assurance  efforts  except  for 
materials  certification  and  receiving  inspection  functions. 

7.  Program  Management 

The  program  management  element  consistently  rated  highest 
among  the  elements  that  were  affected  by  the  new  policy  require- 
ments. This  was  not  surprising  since  it  is  the  program  mana- 
ger's responsibility  to  interpret  the  requirements  of  the 
contractual  effort  and  parcel  work  packages  to  other  functional 
organizations.  When  new  policy  requirements  were  applied,  it 
was  more  efficient  to  add  program  management  staff  than  to  dis- 
turb an  on-going  process  or  a company  functional  group  that  is 
handling  many  other  projects  as  well.  Thus,  it  was  observed 
that  the  DTC  cost  tracking  and  reporting  functions  often  were 
assigned  to  the  program  manager's  staff.  The  program  manage- 
ment staff  is  also  a logical  location  for  multi-functional 
analyses  considering  cost,  performance,  reliability,  maintain- 
ability, and  the  development  program  schedule. 

8.  Financial  Management 

The  response  of  the  contractors  in  financial  management 
occurred  as  a result  of  the  DTC  policies  which,  as  discussed 
earlier,  required  product  cost  estimation  at  frequent  Intervals 
throughout  the  development  program.  Additional  effort  was  also 
noted  under  warranty  policies  as  management  attempted  to  quan- 
tify future  financial  risks  associated  with  warranty  administra- 
tion. All  of  the  new  policies  demanded  that  contractors  improve 
their  cost  estimating  and  forecasting  capabilities.  Because 
the  financial  management  functional  area  was  most  often  respon- 
sible for  providing  services  or  accomplishing  this  task,  their 
efforts  were  increased  substantially. 


9. 


Product  Support  Planning 

Support  planning  is  a function  that  ordinarily  does  not 
contribute  significantly  until  the  second  half  of  the  develop- 
ment program  when  product  designs  reach  the  critical  design 
review  milestone  and  support  concepts  can  be  specifically  linked 
to  the  product  design.  It  was  found  that  product  support 
planning  began  sooner  whenever  warranty  options  were  a possi- 
bility and  more  total  effort  therefore  was  required.  DTC 
Impact  was  found  to  be  minimal  except  for  those  cases  where 
life-cycle  costs  were  critical  to  production  contractor  source 
selection. 

10.  Production  Engineering 

This  function  became  a significant  part  of  the  development 
process  under  the  DTC  policies  when  producibility  concerns 
affecting  production  cost  became  critical.  Several  program 
offices  augmented  their  staff  early  in  the  development  program 
with  production  engineering  personnel  in  order  that  the  first 
preliminary  designs  would  benefit  from  production  engineering 
visibility.  Production  engineering  also  played  a role  in 
designing  equipment  that  could  be  tested,  repaired  or  main- 
tained efficiently  under  a warranty  by  the  contractor.  This 
function  was  one  of  the  areas  most  affected  by  the  new  policies. 

1 1 . Value  Engineering 

Value  engineering  (VE)  was  an  enigma  in  our  studies.  Some 
firms  placed  greater  emphasis  on  value  engineering  during  de- 
sign, while  others  replaced  the  traditional  value  engineering 
function  with  ad  hoc  task  forces  formed  to  reduce  costs.  Our 
analyses  indicated  that  the  identification  of  value  engineer- 
ing with  only  the  specific  requirements  and  incentives  of  a 
contract  VE  clause  restricted  a broader  application  of  this 
talent.  Thus,  the  overall  impact  was  relatively  nominal  for 
each  of  the  policies  examined. 
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12.  Data  and  Reports 

All  of  the  policy  initiatives  resulted  in  additional  re- 
quirements for  contractor  data  and  reports.  DTC  requirements 
surfaced  primarily  in  the  form  of  periodic  production  cost 
estimates  and  cost  variance  reports.  Warranty  requirements 
resulted  in  more  detailed  data  being  required  from  reliability 
demonstration  test  programs  and  planning  documents  to  support 
the  proposed  contractor  repair  or  maintenance  concept.  These 
policies  resulted  in  a moderate  Increase  in  effort  in  this  area. 

1 3 . Contract  Management 

As  the  new  policy  initiatives  were  translated  into  contract 
requirements,  the  contract  management  effort  Increased.  Con- 
tract clauses  calling  for  cost  goal  demonstrations  and  Incentive 
fee  provisions  resulted  in  new  contract  analyses.  The  negotia- 
tion of  complex  and  detailed  warranty  or  GSC  clauses  to  be 
applied  to  future  production  contracts  also  represented  a 
large  impact.  In  most  of  the  programs  examined,  the  formula- 
tion and  mutual  agreement  on  proposed  contractual  warranty 
provisions  occupied  several  months  of  intensive  and  sustained 
effort  during  the  engineering  development  program. 

E.  SUMMARY  OF  DEVELOPMENT  PROGRAM  RESPONSE 

The  acquisition  policies  examined  in  this  paper  had  a 
significant  Impact  upon  the  planning  and  execution  of  many 
engineering  development  programs.  DTC  policies  greatly  affected 
the  functions  of  design,  program  management,  materials  manage- 
ment, and  production  engineering  while  policies  leading  to 
reliability  guarantees  and  warranties  Impacted  heavily  in  areas 
of  design,  materials  management,  equipment  test,  financial 
management,  program  management,  and  contract  management.  There 
is  evidence  that  all  the  development  functions  were  affected  by 
the  new  policies  to  some  degree. 
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The  relative  magnitude  of  the  policy  impacts,  together 
with  the  aggregate  impact  upon  the  development  program  func- 
tional elements,  are  shown  in  Figure  3*  It  is  seen  from  the 
figure  that  the  policies  contribute  to  the  overall  Impact  in 
different  ways.  DTC  policies  primarily  concerned  with  acqui- 
sition cost  compliment  the  warranty  impact  in  the  design, 
analyses,  materials  management,  financial  management,  and 
program  management  functions.  Warranty  policies  which  focus 
on  future  operations  and  maintenance  experiences  (and  cost) 
dominate  the  impact  in  areas  of  equipment  test,  quality  assur- 
ance, product  support,  and  contract  management. 

It  is  difficult  to  quantify  the  observed  impact  in  terms 
of  either  effort  or  cost.  For  the  warranty  policies,  our 
research  indicated  that  those  contractors  who  reported  an  im- 
pact estimated  that  it  resulted  in  a twelve  percent  increase 
in  development  effort  and  a comparable  increase  in  cost.  How- 
ever, only  half  of  the  contractors  surveyed  reported  an  Impact. 
Most  of  the  others  reported  that  program  or  institutional  bar- 
riers prevented  taking  additional  development  actions.  It  was 
also  discovered  that  peculiarities  of  the  program  or  barriers 
prevented  most  contractors  from  responding  fully  to  DTC  poli- 
cies. A summary  of  these  policy  barriers  identified  by  the 
research  is  presented  below. 


FUNCTIONAL  ELEMENT 


Figure  3.  SUMMARY  OF  DEVELOPMENT  PROGRAM  IMPACT 


CONTRACTOR  RESPONSE  AND  CONTRACTOR  SUCCESS 


It  was  not  possible  to  draw  conclusive  cause  and  effect 
relationships  between  any  specific  development  program  charac- 
teristic and  contractor  success  in  winning  the  production  con- 
tract. However,  the  consistent  behavior  of  the  winning  con- 
tractors is  interesting.  Sixty-five  percent  of  the  successful 
contractors  had  formalized  the  DTC  requirements  with  policies 
and  procedures  of  their  own.  While  there  seemed  to  be  no 
recurring  pattern  to  the  type  of  organizational  structure,  in 
every  case  except  one,  production  or  produclbillty  engineering 
occupied  a major  place  in  the  development  program  organization. 
Cost  management  also  was  a strong  suit  for  the  winning  contrac- 
tors. Another  common  characteristic  was  that  the  successful 
contractors  developed  a detailed  cost  estimating,  tracking,  and 
reporting  system  independent  of  contractual  reporting  require- 
ments. In  terms  of  program  element  Impact,  the  tabulation  of 
the  successful  contractors  was  also  noteworthy.  There  was  a 
three-to-one  difference  in  effort  reported  between  successful 
and  unsuccessful  contractors  in  almost  every  category  examined. 
It  is  not  clear  whether  other  program  characteristics  such  as 
technical  performance  may  have  been  more  Important  determinants 
of  success  than  contractor  response,  but  it  is  believed  that 
the  contractors  who  strongly  embraced  the  Intent  of  the  policy 
initiatives  were  in  a more  confident  posture  when  the  produc- 
tion RFP  arrived. 


V 

BARRIERS  TO  CONTRACTOR  RESPONSE 

The  contractor  response  observed  for  the  recent  acquisi- 
tion initiatives  was  usually  not  optimum  to  pursue  or  achieve 
the  policy  objectives.  It  was  commonly  observed  that  the 
potential  for  a greater  or  more  effective  response  was  present, 
but  institutional  or  program-unique  barriers  prevented  this 
from  occurring.  The  problem  areas  or  policy  barriers  encounter- 
ed, listed  in  order  of  their  reported  frequency,  are  shown  in 
Table  4. 

A full  discussion  of  these  and  other  program-peculiar 
problem  areas  is  beyond  the  scope  of  this  paper.  However, 
some  general  observations  related  to  contractor  response  are 
worth  mentioning. 

A recurring  problem  observed  in  many  of  the  cases  examined 
is  that  the  expected  policy  outcome  is  often  based  upon  the 
premise  that  the  acquisition  environment  is  favorable  or  can  be 
easily  modified  to  accommodate  the  new  policies.  Examples  of 
this  are  (1)  the  expectation  that  there  will  be  additional 
time  and  money  available  in  the  development  programs  to  iter- 
ate equipment  designs  in  order  to  meet  pre-set  design  cost 
goals;  (2)  the  expectation  that  the  development  test  programs 
will  provide  realistic  indications  of  expected  operational 
reliability  and  maintainability;  and  (3)  the  expectation  that 
new  policies  can  be  readily  converted  to  contractual  require- 
ments and  will  instantly  Implement  fundamental  changes  in 
contractor  behavior.  These  expectations  were  never  fully 
realized  in  the  programs  analyzed. 
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Table  4.  POLICY  BARRIERS  AND  PROBLEM  AREAS 


CONFLICTS  BETWEEN  POLICIES  40  MAJOR  MAJOR 


Another  problem  area  we  found  was  that  related  policy 
concepts  are  not  usually  compatible  when  output  priorities  con- 
flict. A policy  calling  for  fixed-price  guarantees  of  relia- 
bility, maintainability,  or  support  cost  will  not  be  easily 
Integrated  Into  a DTC  program  whose  firm  unit  production  cast 
targets  have  already  been  set  without  R&M  or  life-cycle  cost 
considerations . 

Finally,  the  policies  we've  studied  are  designed  to  funda- 
mentally change  the  way  systems  and  subsystems  are  developed 
and  acquired.  In  order  for  these  changes  to  occur,  the  need 
for  change  must  be  clearly  recognized  and  the  benefits  for 
change  must  be  clearly  visible — these  are  Ingredients  of  policy 
credibility.  If  the  contractor  perceives  a lack  of  credibility, 
policy  response  will  be  reflective  and  fundamental  changes  will 
not  be  Implemented.  In  this  case,  credibility  (or  the  lack  of 
credibility)  becomes  a barrier  to  Implementing  change. 


VI 

FUTURE  DEVELOPMENT  PROGRAM  PLANNING 

Based  upon  our  observation  of  recent  policy  Initiatives 
and  the  subsequent  contractor  experiences  and  response,  there 
are  several  lessons  learned  that  could  aid  contractors  In 
future  development  program  planning. 

The  first  Is  that  successful  contractors  took  the  Initia- 
tive, Interpreted  the  Intent  of  the  policies,  and  translated 
policy  Intent  Into  operating  practice  In  advance  and  Indepen- 
dent of  Government  contract  requirements.  This  procedure  was 
risky  and  Increased  financial  exposure  during  the  critical 
early  development  period.  Successful  contractor  behavior  dur- 
ing the  development  program  was  not  unlike  that  of  companies 
who  were  developing  products  for  the  commercial  sector.  How- 
ever, Institutional  arrangements  effectively  blocked  a full 
commercial  response. 

The  second  lesson  learned  Is  that  these  new  policies  can 
be  Implemented  much  more  easily  If  major  barriers  to  their 
execution  are  recognized  and  accounted  for.  The  following 
conditions  should  be  present  for  new  acquisition  policy 
success : 

1)  The  Government  program  office  must  firmly  believe  In 
and  endorse  the  policy  . 

2)  The  policy  must  be  appropriate  to  the  development 
program  under  consideration. 

3)  Sufficient  time  should  remain  In  the  development 
program  to  accomplish  the  goals  of  the  policy. 

4)  Flexibility  should  be  Incorporated  as  part  of  the 
program  to  reverse  previous  decisions  If  the  new 
policy  requires  a changed  product  design  or  develop- 
ment program. 
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5)  Contractual  requirements  for  policy  application  must 
be  analyzed  and  agreed-to  at  an  early  stage. 

6)  Areas  of  policy  interference  with  present  program 
policy  and  planning  should  be  analyzed  and  resolved. 

7)  Additional  funds,  if  required,  should  be  available 

to  execute  the  development  program  in  accordance  with 
new  policy  guidelines. 

The  major  lesson  learned  is  that  policies  aimed  at  reducing 
total  product  life-cycle  costs  will  probably  require  more  time 
and  effort  during  development  than  otherwise  would  have  been 
expended.  Basic  development  engineering  disciplines  such  as 
design,  analysis,  test,  and  evaluation,  together  with  program 
management,  will  be  affected.  Indirect  functions  such  as 
financial  management,  materials  management,  and  contract  manage- 
ment may  also  require  more  effort  to  properly  analyze  and  im- 
plement the  policies.  Ways  should  be  explored  to  efficiently 
expend  these  valuable  front-end  dollars  which  can  have  great 
leverage  on  the  cost  and  outcome  of  the  total  program. 


VII 

CONCLUSIONS 


Contractor  response  to  recent  acquisition  policy  initia- 
tives was  examined.  It  was  found  that  new  policy  application 
to  the  initial  programs  often  was  only  partially  effective 
because  of  Improper  timing  and  delays  in  policy  acceptance. 
Nevertheless,  significant  contractor  response  was  found  in 
areas  of  policies  and  procedures,  organizational  structure, 
cost  management,  and  development  program  planning.  It  was 
found  that  beneficial  contractor  response  usually  required 
more  development  time  and  effort.  The  potential  for  a greater 
and  more  effective  response  was  identified  if  institutional 
and  acquisition  environment  barriers  could  be  attenuated  or 
eliminated. 

Changes  in  contractor  behavior  leading  to  improvements 
in  system  and  subsystem  cost,  reliability,  and  maintainability 
are  difficult  to  Implement  exclusively  through  new  policy 
initiatives.  Positive  contractor  response  will  depend  upon 
many  factors  ranging  from  the  perceived  credibility  of  the 
Government  to  the  successful  accommodation  of  policy  barriers 
contained  in  the  present  acquisition  process. 
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